ACCELERATED FINITE DIFFERENCE SCHEMES FOR 
LINEAR STOCHASTIC PARTIAL DIFFERENTIAL 
EQUATIONS IN THE WHOLE SPACE 



ISTVAN GYONGY AND NICOLAI KRYLOV 

Abstract. We give sufficient conditions under which the convergence 
of finite difference approximations in the space variable of the solution to 
the Cauchy problem for linear stochastic PDEs of parabolic type can be 
accelerated to any given order of convergence by Richardson's method. 



1. Introduction 

Stochastic partial differential equations (SPDEs) play important roles in 
many applied fields. Here we consider linear second order nondegenerate 
parabolic SPDEs. These equations arise, for example, in nonlinear filter- 
ing of partially observable diffusion processes. There are various methods 
developed in the literature to solve them numerically. In this paper we ap- 
ply the method of finite differences in the space variable, while the time 
variable changes continuously. It is known that in general the error of the 
finite difference approximations in the space variable is proportional to the 
parameter h of the finite difference, see, e.g., [22] or [23]. Our aim is to 
show that the convergence of these approximations can be accelerated by 
an implementation of Richardson's idea to SPDEs. We prove that for linear 
parabolic stochastic PDEs driven by Wiener processes the finite difference 
approximations admit power series expansions in the parameter h. This 
is Theorem 2.2, one of the main results of the paper. Hence we get Theorem 
2.4, our first result on acceleration of finite difference schemes for SPDEs. It 
says that if the coefficients and the data are sufficiently regular then the con- 
vergence of finite difference approximations can be accelerated to any high 
order by taking appropriate mixture of approximations with different step 
sizes. In the special case of symmetric finite difference schemes. Example 
2.2 below, the coefficients of odd powers in the expansions vanish. Hence 
it follows, see Theorem 2.5, that the error of symmetric finite difference 
schemes is proportional to h"^ without acceleration, and we can accelerate 
more effectively. 
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The SPDEs we consider in this paper are given in [0, T] X M"^. The finite 
difference schemes are given in [0, T] x Gh, where Gh are grids in the space 
variable. The supremum in t € [0, T] and x G of the remainder terms and 
of the approximation errors in the expansions in Theorem 2.2 and Theorems 
2.4-2.5, respectively are estimated. To prove these results we consider the 
finite difference schemes given not only on the grids, but on the whole W^, 
and obtain a more general theorem. Theorem 4.1, that establishes a power 
expansion in h for the L2-solutions of the schemes on [0, T] x M'^, with the 
remainder estimated in terms of Sobolev norms in the whole W^. Hence we 
estimate the sup norm and also discrete Sobolev norms of the remainder 
by Sobolev's embedding theorems, and get our theorems on accelerated fi- 
nite difference schemes, formulated in terms of supremum norm and also in 
discrete Sobolev norms of functions over G/j. 

In the special case when the stochastic terms in the equations vanish 
the above mentioned theorems are results on accelerated finite difference 
schemes for deterministic PDEs. Similar results on monotone finite differ- 
ence schemes for parabolic and elliptic PDEs, which may degenerate, are 
proved in [9] on the basis of derivative estimates on the supremum norm 
obtained in [7]- [8] for solutions to monotone finite difference schemes. The 
finite difference schemes in the present article are not necessarily monotone. 

The idea of accelerating the convergence of finite difference approxima- 
tions to deterministic PDEs by suitable mixtures of approximations with 
different step-sizes is due to L.F. Richardson, see [18] and [19]. This method 
is often called Richardson's method or extrapolation to the limit, and is ap- 
plied to various types of approximations. It is used in [5]- [6] to accelerate 
splitting up approximations for a large class of deterministic evolution equa- 
tions, including second order parabolic equations and symmetric hyperbolic 
system of first order PDEs. Richardson's idea is implemented to the law of 
Euler's approximations for stochastic differential equations in [21], [1] and 
[15]. There is a lot of other applications of Richardson's method. The reader 
is referred to the survey papers [2] and [4] for a review on the method, and 
to textbooks (for instance, [16] and [17]) concerning finite difference meth- 
ods and their accelerations. We note that previous extrapolation results for 
stochastic equations, i.e. in [21], and in its generalizations [15] and [12], are 
concerned with week approximations of stochastic differential equations. In 
contrast our main results are error expansions for strong convergence of fi- 
nite difference approximations in the space variable for stochastic parabolic 
equations, and as far as we know these are the first results in this direction. 

In light of the results of the present paper it is natural to look for accel- 
erated space and time discretized schemes, say by using time discretization 
to solve the systems of ordinary stochastic equations which we obtain after 
discretizing the space. However, one knows that if the values of the driv- 
ing multidimensional Wiener process are available only at the grid points, 
then in general one cannot construct a scheme with (strong) rate of con- 
vergence better than ^/T, where r is the mesh-size of the time grid. On 
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the other hand, in some particular cases, e.g., when the Wiener process is 
one-dimenional, or some special data, like iterated stochastic integrals of the 
components of the Wiener processes are available, then one can have accel- 
erated fully discretised numerical schemes for SPDEs. (See, e.g., [11] for 
high order strong approximations of stochastic differential equations when 
appropriate iterated stochastic integrals of the Wiener processes are used in 
the numerical schemes.) 

We did not try to make our results as sharp or as general as possible. 
The main goal of the article is to show a method of approximating. We 
plan to extend our results to the case of degenerate parabolic SPDEs in the 
continuation of this paper. 

In conclusion we introduce some notation used everywhere below. Through- 
out the paper is a Euclidean space of points x = {x^, ...,x'^), and T > 
is a fixed finite constant. We set 

Di = d/dx^, i = l,...,d. 

Also let -Do be the unit operator. 

Let {Q,J^,P) be a complete probability space, J^t, t > 0, be an increasing 
filtration of sub cr-fields of T, such that To is complete with respect to 
{F,P). By V wc denote the cr-field of predictable subsets of $7 x [0, oo) 
generated by Jj, and B{W^) is the a-algebra of the Borel subsets of M''. 
We assume that on we are given a sequence of J^^-adapted independent 
Wiener processes {it;^}^^ such that for every integer p > 1 and for all 
< s < t the increments — w§ are independent of J^,. Unless otherwise 
stated throughout the paper we use the summation convention over repeated 
integer valued indices. For functions u = u{uj,t,x), oo e O,, t e [0,T],xGM'^, 
we use the notation D^'u = D^u{x) for the collection of lt\\ order derivatives 
of u with respect to x and iD'up = |D'n(x)p is the sum of squares of all /th 
order derivatives at x. If « is an /2-valued function then the differentiability 
of it is understood in the sense of Z2-valued functions and \D^u{x)\^^ means 
the the sum of squares of the Z2-norm of all Ith order derivatives at x. For 
basic notions and notation concerning the theory of linear stochastic partial 
differential equations we refer to [20]. 

Acknowledgments. The first version of this paper was presented at the 
ICMS conference on 'Numerical Analysis of Stochastic PDEs' (Edinburgh, 
May 2009), organised by Evelyn Buckwar and Gabriel Lord, and at the 'Sto- 
chastic Analysis' session of the 7th International ISAAC Congress (Imperial 
College, London, August 2009) organized by Dan Crisan and Terence Lyons. 
We thank the organisers for the invitations. 

We are sincerely grateful to the referees for their careful work which helped 
improve the presentation of the paper. 

2. Formulation of the main results 
We consider the equation 
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dut = {Ctut + ft) dt + (MS + 9?) (2-1) 
for G [0, r] X =: Ht with some initial condition where 

Ct4> = afDaDpct>, M't(t> = K'Dact>, 

and {wfy^^ is a sequence of independent Wiener processes given on a prob- 
abihty space {Q, J^, P) equipped with a filtration {J-^)t>o such that is 
measurable and — Wg is independent of J-g for all < s < t and integers 
p > 1. Here and below the summation with respect to a and /3 is performed 
over the set {0,1, and with respect to p in the range {1,2,...}. As- 

sume that, for a, /3 € {0, 1, d}, we have a"^ = and a"^ = a'^^{x) are 
real-valued and bf = (6°'')^]^ are Z2-valued V x i3(M'^)-measurable functions 
on ri X Ht- 

Let m > 1 be an integer and let be the usual Hilbert-Sobolev space 
of functions on with norm || • \\w^- 

Assumption 2.1. (i) For each {uj,t) the functions af^ are m times and 

the functions bf arc m + 1 times continuously differcntiablc in x. There 
exist constants Ki, I = 0, ...,m + 1, such that for all values of indices and 
arguments we have 

\D^af\ <Ku l< m, \D^b'^\i^ < Ki, l<m + l. 

(ii) There is a constant k > such that for all (u, t,x) G O x Ht and 

Assumption 2.2. We have uq G L2(0, Jb, W^'^^). The function ft is 14^2""- 
valued, , p = 1, 2, are W^'^^-valued functions given on O x [0,T] and 
they are predictable. Moreover, for gt := (^f )^i and 

00 

p=i 

we have 

r 2 2 22 

Jo ^ ^ 

Remark 2.1. If Assumption 2.2 holds with m > d/2, then by Sobolev's 
embedding of VF™ into Cb, the space of bounded continuous functions, for 
almost all u we can find a continuous function of x which equals to uq almost 
everywhere. Furthermore, for each t and uj we have continuous functions of 
X which coincide with ft and gt, for almost every x G M'^. Therefore when 
Assumption 2.2 holds with m > d/2, we always assume that uq, ft and gt 
are continuous in x for all t. 
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The solutions of (2.1) will be looked for in the Hilbert space 

One knows, see e.g., [14] or [20], how to define stochastic integrals of Hilbert- 
space valued processes and equation (2.1) is understood accordingly. Ob- 
serve that since uq G L2{fl, J-'o, W^) the solutions of (2.1) automatically are 
continuous VK™-valued processes (a.s.). 

We are going to use the following classical result (see, for instance, The- 
orem 5.1, Remark 5.6, and Theorem 7.1 of [13]). 

Theorem 2.1. Under the above assumptions there exists a unique solution 
u G W™^^(T) of (2.1) with initial condition uq. Furthermore, with proba- 
bility one the function ut is a continuous W^^^ -valued function and there 
exists a constant N depending only on T , d, n, m, and Ki,l < m -\- 1, such 
that 

E sup \\Ut llii/m+l -\- E I ||ii(|L „+2 dt < -/V/C™. 

Remark 2.2. In the future we are going to assume that m + 1 > d/2. Then 
by Sobolev embedding theorems the solution ut{x) from Theorem 2.1 is a 
continuous function of {t,x) (a.s). More precisely, with probability one, for 
any t one can find a continuous function of x which equals Ut{x) for almost 
all X and, in addition, the so constructed modification is continuous with 
respect to the couple {t,x). 

We are interested in approximating the solution by means of solving a 
semidiscretized version of (2.1) when partial derivatives are replaced with 
finite differences. For A = set 6h,\ to be the unit operator and for the 
other values of A G M'^ let 

dh,\u(x) = — ^ — for G M \ {0}. 

We draw the reader's attention to the fact that h can be of any sign. This 
will be important in the future. 

To introduce difference equations we take a finite set A C M'' containing 
the origin, and consider the equation 

dul = iLl4 + ft) dt + (M^^u,^ + 5f ) d<, (2.2) 

with 

where the summation is performed over X, n £ A and in (2.2) also with 
respect to p = 1,2, Assume that, for A,/x G A, o'^'* = a^'^(a;) are real- 
valued and = bt{x) = (b^''(a;))^i are Z2-valued functions on x Ht, 
measurable with respect to V x B{M.'^). 

Set Aq := A \ {0}. Let m > be an integer. Set ffi = max(m, 1), and let 
^iv) be some constants. The functions o and b are supposed to 
possess the following properties. 
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Assumption 2.3. (i) For each {u!,t) and A, G Aq and u G A, a^^ are 
m times continuously difFerentiable in x, a^^, a^*^ are m times continuously 
differentiable in x and are m times continuously differentiable in x as 
/2-valued functions. For all values of arguments we have 

\D^af\ < Aj, \D^af\ < Aj, \D^b^\i.^ < Aj, A G A, j <m. 
(ii) For all (w, t,x) £ Q x Ht and numbers A G Aq, we have 

A,/iGAo AgAo 

Introduce 

Gh = {Ai/i + ... + \nh:n = l, 2, Ai G A U (-A)} 
and let hi^h) be the set of real-valued functions u on such that 

xeGh 

The notation hiG^) will also be used for Z2-valued functions like g. 

Remark 2.3. Observe that, under Assumption 2.3 (i), equation (2.2) is an 
ordinary ltd equation with Lipschitz continuous coefficients for Z2(<G/i)-valued 
processes. Therefore if, for instance, (a.s.) 

/ i\ft\l(G,) + \9t\liG,))dt<^^ 

J 

and Assumption 2.3 (i) holds then equation (2.2) has a unique solution with 
continuous trajectories in hiGh) provided that the initial data Uq G hiGh) 
(a.s.). 

For equation (2.2) to be consistent with (2.1) we impose the following. 
Assumption 2.4. For all i,j = 1, ...,d and p = 1,2, ... 

a* ^ IJ' -at , <^t ^ + fJ = + , ot = , 

A,/ieAo AeAo /ieAo 

AeAo 

Remark 2.4. Clearly, if 

is an invertible matrix for some lo, t, x, then Aq spans the whole W^. On the 
other hand, if Aq spans W^, then clearly a constant k' > exists such that 

E lE^'-^^l^ - '^'l^l^' for aUz = (z\...,z'^) gM^ 
AeAo i 
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and therefore Assumptions 2.3 (ii) and 2.4 imply Assumption 2.1 (ii). It is 
not hard to see that Assumptions 2.1 (ii) and 2.4 do not imply Assumption 
2.3 (ii), in general, unless Aq is a basis in W^. 

There are several ways to construct appropriate o and b. 

Example 2.1. The most natural, albeit sometimes not optimal, way to 
choose a and b is to set A = {eo,ei, ...,6^}, where cq = and Cj is the ith. 
basis vector in and let 

ar' = af, br' = br, a,/3 = 0,l,...,d. 

Thus, in (2.2) the first order derivatives in (2.1) are approximated by usual 
finite diflcerences and 

X] ^t^Kx^-h,tiU = -a\^ 5h,eM-ejU, (2.3) 
A,;ieAo 

which is a standard finite-diflcerence approximation of a/DiDjU. Also notice 
that 

at^zxz^ = al^ZeiZej, Y b^P zx = h\P Ze^. 

It follows that a and b satisfy the above assumptions as long as a and b do. 

Example 2.2. The second choice is to use symmetric finite difi^erenccs to ap- 
proximate the first-order derivatives. Namely, we take Aq = {±ei, ...,±6^} 
and 

ar=ar, br=br, 

so that, for instance, 

AgAo i=l 
For A, G Aq we define a^^ by 

Then Assumption 2.4 is satisfied and formula (2.3) holds again (a*-' = a-^'). 
If Assumption 2.1 (ii) is satisfied, then for any numbers z\ 

-(1/4) E I E ^r^e. - E 6r.-e. r > e - ( V2) e I E ^r-ej' 

p 1=1 1=1 »)J=1 P i=l 

+ E«^-e.^-e.-(l/2)ElE^^-ej' 
i,j=l p i=l 
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d d 

i=l i=l AeAo 

SO that Assumption 2.3 (ii) is also satisfied. By comparing Theorems 2.4 
and 2.5 and also definitions (2.6) and (2.9) for approximations v!^ and 
below, notice that the above choice of a and b is better than that of the 
previous example, in the sense that for u'' wc have fewer terms to calculate 
than for to get the same order of accuracy of the approximations. 

Our results revolve about the possibility to prove the existence of random 
processes uf\x), t G [0, r],a; G M'^, j = 0,...,k, for some integer k > 
such that they are independent of h, is the solution of (2.1) with initial 
value uo and almost surely we have 

"'(^) = E7r^J'^(^) + ^'(^) (2-4) 

j=o ■'■ 

for /i / and for all t G [0, T] and x G G/j, where is the solution to (2.2) 
with initial data uq and is a continuous ^2(G/i)-valued adapted process, 
such that 

E sup sup \E!i{x)\^ < iV/i2^'=+i)/C^ (2.5) 

t£[0,T]xeGh 

with a constant N independent of h. 

Theorem 2.2. Let Assumptions 2.1, 2.2, 2.3 and 2.4 hold with 

xn = m>k + l + d/2, 

where k > is an integer. Then expansion (2.4) and estimate (2.5) hold 
with a constant N depending only on A, d, m, Kq, K^^i, Ao,...,Am, 
K, and T. 

Remark 2.5. Actually Uf{x) is defined for all x e rather than only on 
Gh and, as wc will see from the proof of Theorem 2.2, one can replace Gh 
in (2.5) with R'^. 

Remark 2.6. Let Aq be a basis in M'^ such that Assumption 2.4 holds. Then 
Assumption 2.1 (i) implies Assumption 2.3 (i), and Assumption 2.1 (ii) 
implies Assumption 2.3 (ii) with m = m. Thus if Assumptions 2.1 and 2.2 
hold with 

m> k + l + d/2, 
then the conditions of Theorem 2.2 are satisfied. 

Equality (2.4) clearly yields 

k 

dh,x4{x) = ^ ^5h,xui'\x) + 5H,xRti{x) 

3=0 ^' 
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for any A = (Ai, A„) £ A" and integer n > 0, where A° = {0} and 

Sh,x ■= Sh,\i ■ ■■■ ■ ^h,\„- 
Theorem 2.2 can be generahsed as follows. 

Theorem 2.3. Let the conditions of Theorem, 2.2 hold with 

m = m > k + n + 1 + d/2 

for some integers k > and n > 0. Then expansion (2.4) holds and for 
A = (Ai,...,A„)gA" 

E sup snp\dh,xRl{x)f+E sup ^ |4,Ai?!*(x)n/i|'^ < AT/t^M/C^ 
te[o,T] xeGh te[o,T] ^^^^ 

where N depends only on A, d, m, Kq, K^+i, ■■■T^m> cin-d T. 

We prove Theorem 2.3 in Section 4 after some preliminaries presented in 
Section 3. To discuss the method of acceleration we fix an integer k>0 and 
set 

u^ = j2h,u--'\ (2.6) 

where, naturally, are the solutions to (2.2), with 2~^h in place of h, 

{bo,h,-,bk) ■■= (l,0,0,...,0)F-i (2.7) 

and is the inverse of the Vandermonde matrix with entries 

yij .= 2-(^-l)(^-l), i,j = l,...,k + l. 

The following consequence of Theorem 2.2 is the first main result of the 
paper on accelerated convergence. Its generalisation is presented in Section 
4. 

Theorem 2.4. Under the assumptions of Theorem 2.2 we have 

Esnp sup \u'l{x) - 4^\x)f < Ar|/i|2(^+i)/C^, (2.8) 

t<T xeGh 

where N depends only on A, d, m, Kq, Km+i, k, Aq, ...,Am, and T. 
Proof. By Theorem 2.2 

^2-. = ^(0) + ^ + = 0, 1, k, 

i=l 



with := h i'y^+'^)R^ , which gives 

u^=j: h,u--'^ = (x: h,)u^^ + E + e b^r^-^^h'^^^ 

j=0 j=Q j=0 i=l ■ j=0 

= ^^'^ + E J^^'^ E ^ + E bjr'"' = u^'^ + E b,r'-''h'^^\ 
i=i j=0 j=0 j=0 
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Since 

k k 

J2bj = l, ^6,2-^=0, i = l,2,...k 

j=0 j=0 

by the definition of {bo,...,bk)- This and (2.5) yield the result and the 
theorem is proved. □ 

Remark 2.7. Let the conditions of Theorem 2.2 hold with 

m = m> k + l + n + d/2, 

where k and n are nonnegative integers. Then (2.8) holds with Sh^xu'^ and 
Sh,xu^'^^ in place of and u^^\ respectively, for A G A". 

Proof. This follows from Theorem 2.3 in the same way as Theorem 2.4 fol- 
lows from Theorem 2.2. □ 

By the above remark one can construct fast approximations for the deriva- 
tives of u^'^^ via suitable linear combinations of finite differences of iz'*. 

Sometimes it suffices to combine fewer terms to get accuracy of 

order k + 1. For integers A; > define 

k 

«'^ = ^6ju2"''^, (2.9) 

j=0 

where 

(boM,-,k) ■= (1,0,0,..., o)y-\ k = [l], 

and V^^ is the inverse of the Vandermondc matrix with entries 
yij 4-(i-i)0--i)^ = ^ + 1, 

Theorem 2.5. Let the conditions of Theorem 2.2 hold. Then in the situa- 
tion of Example 2.2 we have 

Esuv sup \u'l{x) - uf \x)\^ < iV|/i|2('=+i)/C^, (2.10) 

t<TxeGh 

where N is a constant depending only on d, m, k, Kq, . . . , K^+i, Aq, A^, 
andT. 

To prove this result we need only repeat the proof of Theorem 2.4 taking 

into account that in (2.4) we have ■up'' = for odd j < k since = u^^ 
owing to the fact that in the case of Example 2.2 equation (2.2) does not 
change if we replace h with —h. 

Remark 2.8. Notice that without acceleration, i.e., when = 1 in the above 
theorem, the mean square norm of the supremum in t and x of the error 
of the finite difference approximations in Example 2.2 is proportional to 
h^. This is a sharp result see, e.g.. Remark 2.21 in [3] on finite difference 
approximations for deterministic parabolic PDEs. 
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Example 2.3. Assume that in the situation of Example 2.2 we have d = 2 
and m = 7. Then 

satisfies 

Esup sup \u[^\x) - u'^{x)\ < Nh"^. 

t<TxeGh 

Example 2.4. Take d = 1 and consider the following SPDE: 

dut = SD^ut dt + 2Dut dwt 

with initial data uo{x) = cosx, where wt is a one-dimensional Wiener pro- 
cess. Then a unique bounded solution is ut{x) = cos{x + 2wt). Exam- 
ple 2.2 suggests the following version of (2.2): 

du^x) = ,-n- + h)-2unx) + unx-h) ^ unx + h)-unx-h) ^^^^ 

the unique bounded solution of which with initial condition cos x is given by 

h sin h 

vliix) = e~'"'*cos(x + 2(j)hWt), h'^Ch = 12sin^ - - 2sin^ h, (j)h = —r—- 

^ ft 

For t = 1, h = 0.1, and u;^ = we have 
ui{0) 0.3678794412, n^(0) 0.366352748, u^'^iO) 0.3674966179, 

^5^(0) = |mi^^(0) - 14(0) ^ 0.3678779079. 

It is instructive to observe that such a level of accuracy is achieved for (0) 
with h = 0.00316, which is more than 15 times smaller than h/2. 

Actually, this example does not quite fit into our scheme because uq is not 
square summable over M. In connection with this we reiterate that the main 
goal of the present article was to introduce a method and not to prove the 
most general results. Without much trouble our approach can be extended 
to a class of SPDEs with growing data by the help of weighted Sobolev 
spaces (see [10]), and then the above example can be included formally. 

3. Auxiliary facts 

The following fact is easily obtained by Young's inequality owing to As- 
sumption 2.3. 

Lemma 3.1. Let Assumption 2.3 hold. Then for all E L2 we have 

„ 00 
Qt{^):= / [2ip{x)L^^ix) + ^\M^Mx)\']dx 

<-^ElKA¥'llL+iV||¥'llL, 
AeAo 

where N depends only on k, Aq, Ai, and the number of vectors in A. 
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Proof. First observe that for G Aq the conjugate operator in L2 to 
is Sh,ij,. Notice also that 

where Th^nil>{x) = ip{x + hn). Thus by simple calculations we get 

4 



with 



(<^) = / 2a?V'(^) + 2^(x) J] (af (5^,AV^ + c^^5.h,x^){x) dx 

AGAo 

(<^) = / b'tVix) + 2 Y bt'b'/^SnM^) dx. 



AgAo 

Due to Assumption 2.3 (ii) 

AeAo 

By Assumption 2.3(i), Young's inequality and the shift invariance of Lebesgue 
measure 

Qt\f)<'lY II'^M'/'IIL+^II'/'IP' ^ = 2,3,4, 
AgAo 

with a constant depending only on the number of elements of A, k, Aq and, 
for i = 2 also on Ai. We finish the proof by summing up these estimates. □ 

Recall the notation W^(r) = L2{Qx [0, T],V, W^). Remember that W:^ 
denotes the Hilbert-Sobolev space of real-valued and also that of l2-valued 
functions on W^. Thus W™(T) denotes the Hilbert space of predictable 
functions (f) = (f)t on Q. x [0,T] with values in the W^^ space of real- valued 
functions, and W™(T) = W™(T, ^2) denotes the Hilbert space of functions 
g = {g^)^^i with values in the space of i2-valued functions on M"*, with 
norm defined by 

'^rn^j') ^ ^ J W^tWw:^ dt < 00 and 



pi 

l5llw^(T) ^ ^ Yj WdtWw^ dt < 00, 
•^0 0=1 



respectively. 
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Theorem 3.2. Let Assumption 2.3 (i) hold. Let G W^(r), /x G A, and 
{g^)'^i G W2*(r) be some functions. Then for each h ^ there exists a 
unique continuous L2-valued solution of 

dul = {4>'5n,xS-h,A + ^-h,,.fn dt + {h'^'St^xu'l + ) d< (3.1) 
for any W2^-valued To-measurable initial condition uq. This solution is a 
W2^-valued continuous process. Moreover, if Assumption 2.3 (ii) is also 
satisfied, then 

Esnp ll^t^llwrn +E V \\6h,x4fw^ dt 

<NEf (5^||//^f^™ + ||5tf^™)dt + 7VE||uo||^n„ (3.2) 

MeA 

where N depends only on d, m. A, k, Aq, . . . ,A^, and T. 

Proof. The first assertion is a simple consequence of the fact that (2.2) 
is an ordinary Ito equation with Lipschitz continuous coefficients for L2- 
valued processes. Similarly, (2.2) has a unique W2"-valued solution and, 
since W2' C L2, this proves that the L2- valued solution is actually TVJ^" 
valued. Moreover, we can easily get estimate (3.2) with a constant N which 
depends on h. In particular we have that the solution is in W2*(r). 

The proof of estimate (3.2) with N independent of h is rather standard 
but still contains a point which usually does not appear. This concerns the 
treatment of a^'^Sh,\S-h,fj.u^ after (3.8) without assuming that 2 derivatives 
of a are bounded. 

By Ito's formula for L2-valued processes we find 

d\\uni = {Qti4) + 2(n^/n + 2{b'^6,,,u1,g^) + H\\ljdt 

+2{u1,b^P5h^xu1 + g?)dw',. (3.3) 

We use Lemma 3.1, the inequalities like \ab\ < ea^ + £~^b'^, and Assump- 
tion 2.3 (i) to conclude that 

EhlWl + r E Pm^'IIL ds < E\\uo\\l 
+NE f {\\u^,\\l^ + ^ + ||5.||iJ ds < 00. (3.4) 

•^0 AGA 

By Gronwall's lemma we can eliminated the first term in the integral on the 
right in (3.4) and get that 

E TEII^M^'IIL ds<NE\\uo\\i, 
•^0 AeA 

+NE [\^\\f^\\l + \\gs\\l,)ds. (3.5) 
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After that we come back to (3.3) and use Davis's inequality to derive that 

Esuv\\vli\\l^<NE\\uo\\l^ 

t<T 



+NE [ {Y,\\ft^\\l, + \\9t\\i,)dt + mJ, (3.6) 
•^0 ASA 

where 

J = E{ ^(/ \4{b^PSn,x4 + gO\dxfdtf' 

Jo ~^ JmA 

Jo 

<Esup\\u1\\l,{ [ \\b%,xu1 + gt\\l,dt)'^^ 

t<T Jo 

< {2N,)-^Esup\\u'l\\l^+NE fiY, WKxu^tWl, + \\9t\\l,)dt. 
t<T Jo ^ 

This and (3.5) allow us to drop the last term in (3.6) which again combined 
with (3.5) yields 

Esnp\\u1\\l^ + E r^^ll^M^t^lLdi 
t<T Jo 

<NE\\uo\\l,+NE r {Y,\\ft\\h + \\9t\\l,)dt. (3.7) 
•^0 AeA 

This proves the theorem if m = 0. If m > 1, we differentiate (3.1) with 
respect to x*, and introduce the notation (p for the derivative of a function 
(f) in x''. Then we obtain 

dul = ia^'' 5h,x5.h,>.u1 + 5.hJn dt + (b^'Sh^xut + g^) dw^ (3.8) 
where 

We proceed with (3.8) as above with (3.1) with one exception that for )U G Aq 
we use the inequality (cf. Remark 3.1) 

^ / / \u%,xS-h,ny!l\dxds< f E\\u^^\\L^\\5h,xdi,u^s\\L2ds 
Jo Jw- Jo 

<e f E\\DSh,xu':\\l,ds + Ne-' f E\\u^,\\l^ds, 
Jo Jo 

where = n^Di and e > is arbitrary and N depends only on (cf. 

Remark 3.1 below). Then we come to the following counterpart of (3.4) 
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ds 



+NE 



+ ll^sll^i) ds. 



(3.9) 



AeA 



Recall that here is the derivative of with respect to x*. By writing 
(3.9) for all i = l,...,d and summing them up we see that the term with 
the factor {2d)~^ is estimated by other terms on the right-hand side of (3.9) 
and, hence, can be dropped. After that the already familiar procedure yields 



which along with (3.7) proves (3.2) with 1 in place of m. 

Once this step is done the rest is routine. Assume that m > 2 and (3.2) is 
true with n in place of m for an integer n G [1, m — 1]. Then we differentiate 
(3.1) n + 1 times and now use the notation (p for certain n + 1-th order 
derivative of <p with respect to x. Then we will obtain (3.8) with slightly 
modified /'^ and gf. Namely, the /° will be the sum of /° and the linear 
combination with constant coefficients of certain i-th derivatives of a^^ times 
certain n + 1 — i-th derivatives of Sh,\S-h,ij.Ut'. Here i should be restricted 
to [l,n -I- 1]. As above, the L2-norms of the n + 1 — i-th derivatives of 
Sh,\S-h,ij,Uf are dominated by the L2-norms of the n + 2 — i-th derivatives 
of Sh^\u^ which are less than the T4^^'''"^-norm of Sfi xu^ an estimate of which 
is contained in (3.2) with n in place of I. Similar changes should be made 
in gP. After that we obtain the corresponding counterpart of (3.10) which 
yields (3.2) with n -|- 1 in place of m. This obviously brings the proof of the 
theorem to an end. □ 

Lemma 3.3. Let n > be an integer, let (f) G VF^'^S tp G VF^'''^, and 
A, G Aq. Set 





(3.10) 



Then we have 




(3.11) 



n 
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for almost all x G M , for each /i G M. Furthermore, if I > is an integer 
and (p G W^+^^^ and ^ G W^+^+^ , then 

a 

=0 



||5m5-m^-5^/i^ j;A,.a;;+^5^'-+V|L. < iv|/.r+i||^||^.+„+3, (3.14) 

i=0 r=0 

where N = N{\\\,\ii\,d,n) and 

= ^r + mi-r + l)V ^^-^^^ 

Proof. Clearly, it suffices to prove the lemma for (j),t/j ^ C^{W^). For n = 
formula (3.11) is obtained by applying the Newton-Leibnitz formula to 
(f){x + 6h\) as a function of ^ G [0, 1]. Applying it one more time derives 
(3.12) from (3.11) for n = 0. After that for n > 1 one obtains (3.11) and 
(3.12) by differentiating both parts of these equations written with n = 1. 
Next by Taylor's formula for smooth f{h) we have 

By applying this to 

5h,x^{x)= I dx(j){x + hex)de 

Jo 

as a function of h we see that 

+^ / / (1 - 02)^^1 + h9ie2X) deide2. 

n\ Jo Jo 

Now to prove (3.13) it only remains to use that by Minkowski's inequality 
the W2-norm of the last term is less than the Wl-TL^ovm of d^'^'^cf) times 

\l,\n+l rl rl l/jl^+l 



— / / (l-^2)X+'(iM^2 = 



n\ Jo Jo" ' ' (ri + 2)! 

Similarly, by observing that the value at /i = of the right-hand side of 
(3.12) is 



n 

71" 



n!5]A„,,a^+i5--'-+V(^) 

r=0 

we see that the left-hand side of (3.14) is the VFj-norm of 

un+\ rl rl rl 

ii-esrieid^-e2d^r+^d^^i,ix+he3ieiX-d2fi))deide2de3. 



n\ Jo Jo Jo 
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This yields (3.14) in an obvious way. □ 

Remark 3.1. Formula (3.11) with n = 1 and Minkowski's inequality imply 
that 

\\Sh,xcf>\\L, < \\dxct>\\L,. 
By applying this inequality to finite differences of (p and using induction we 
easily conclude that W^^^ C W^'g, where for integers / > and r > 1 we 

denote by the Hilbert space of functions (p on with the norm ||¥'||i,r,/i 
defined by 

\Mlr,h= ¥hM ■ - ■ ^h,xM\wl^- (3.16) 

Ai,...,AreA 

We also set W^'" = W^. Then for any (p e Wa^*" we have 

\Ml,h,r < ^\\'P\\wl+-^ 

where N depends only on |Aop := J2x&Ao I'^I^ ^^'^ 
Set 

a,//ga aga 
and for integers n > 1 introduce the operators 

n 

ct^ = n\ Y: ^t' E An,rd{-''d;-^^' + (n + 1)-^ Y ^t'd^' 

x,^ieAo r=o agAo 

+(n + l)-^E^^^r'' 
/iGAo 

Mt'^'^in+ir'Y^t'dr', 

xeAo 

^Kn) =Lh^j2 ^^^^^ = M,'^'" - Y I^J'^^ 

i=0 ' i=0 

where An^r are defined by (3.15). 

Remark 3.2. Formally, for n > 1 the values £4"^ and M^^^^cj) are obtained 
as the values at /i = of the n-th derivatives in h of L^cj) and M^'''<j). 

Remark 3.3. Owing to Assumption 2.4 we have 

cf^=Ct, Mf^'' = Ml. (3.17) 

Also observe that in light of Lemma 3.3, under Assumption 2.3, for G 

^2"+^+' and ip e W^+^+^ we have 

||7^f("VlllyJ<iV|/^ri0ll^^+n+2, (3.18) 
where A?^ denotes constants depending only on n, d, Z, Aq, . . . , and A. 
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Let k G [l,m] be an integer. The functions u[^\ ...,u[''^ we need in (2.4) 
will be obtained as the result of embedding of certain functions v^^^ taking 
values in certain Sobolev spaces. Define -y^^^ as the solution of (2.1) from 
Theorem 2.1 and for finding v^^\...,v^'^^ introduce the following system of 
stochastic PDEs: 



1=1 

+ {M'A''^ +j2cLMfKi^-'^) dw^„ n = l,...,k, (3.19) 

1=1 

where = n(n — 1) • ... • (n — I + 1)/Z! is the binomial coefficient. 

Theorem 3.4. Let Assumptions 2.1, 2.2, and 2.3 (i) hold, m = m, and let 

1 < k < m. Then there exists a unique set vl:^\ vf^^ of solutions of (3.19) 

with initial condition v^^^ = ... = Vq''^ = and such that t;*^"^ G W™^^~"'(T), 

n = 1, k. Furthermore, with probability one v^^^^ are continuous W^'^^~^- 
valued functions and there exists a constant N depending only on T, d, k, 
A, m, and Kq, K^+i, Ao,....,Am such that for n = l,...,k 

Esup + E / dt < NICl^. (3.20) 

Proof. Notice that for each n = l,...,k the equation for v^^^ does not 

involve the unknown functions vf^ with indices I > n. Therefore we can 

prove the solvability of (3.19) and the stated properties of v^""^ recursively 
on n. 
Denote 

n n 

i=l 1=1 

and first let n = 1. By Theorem 2.1 we have G W^'+\T), which owing 
to Assumption 2.3(i) yields that S^^) G W^-^(r) and R^^^ = {R^'^>) G 
W^(T)(hcrc we need the assumption that m = m). Hence, it follows again 
by Theorem 2.1 that there exists a unique v^^^ G W2"^^(r) satisfying (3.19) 

with zero initial condition. Furthermore, v^^^ is a continuous W™-valued 
function (a.s.) and (3.20) holds with n = 1. 

Passing to higher n wc assume that m > k > 2 and for an n G {2, k} 
we have found v^^\...,v^'^~^'> with the asserted properties. Observe that for 
i = 1, . . . , ra 
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E||A/l(*)^7;("~*)||2 < A/"lli;("'~')|l^ . , 

IK^' ^ ||^m-n+l(y) ^ -iV IP ||^m-n+l+(i+l)^^^ 

fe=l 

= ^ll^^"-'^li;^+.-(n-.)(^)- (3-22) 

It follows by the induction hypothesis that 5^") G W^""(r) and G 
^m-n+ij-j.-j^ By applying Theorem 2.1 we see that there exists a unique 



V 



(n) 



G W^-"+2(T) satisfying (3.19) with zero initial condition. This theo- 

(n) 

rem also yields the continuity property of vi and an estimate, that com- 
bined with (3.21) and (3.22) and the induction hypothesis yields (3.20). This 
proves the existence. Uniqueness is obtained by inspecting the above proof 
in which each t;*^") was found uniquely. □ 

Lemma 3.5. Let Assumptions 2.1, 2.2, and 2.3 (i) hold and m = m. Let 
l,k > be integers such that I + k + 1 = m, and let v^^\ ...,v^''^ be the 
functions from Theorem 3.4- Set 

ri = vi-vf'- E "^v?, (3.23) 
i<i<k •'' 

where is the unique L2-valued solution of (3.1) with initial condition uq, 
f^ = f and ft' = Oforiie Aq. Then = 0, r'* G W™-*^(r), and 

dr'^ = {L^A' + Fl') dt + {mI'M' + dw^ (3.24) 

where 

j=0 ^' j=0 ^' 

Finally, G W^(r) and G^'' G W^+^(r). 

Proof. Due to Assumptions 2.2 and 2.3(i) we have G W^(T), and owing 
to Assumptions 2.1 and 2.2, by Theorem 2.1 we have G W™+2(r). 
Hence clearly r'' G ^"(r) when k = 0, and r'* G W^"''(r) follows from 
Theorem 3.4 when k > 1. A direct computation shows that (3.24) holds 
with F and G in place of F and G, respectively, where 

l<j<k l<j<k 

i-ii i-ii 
Qh,p ^ Mh,p^{0) _ j^p^io) ^ Mh,Pyij)l_- MPy^^^-^ - J'^^P, 

l<j<k l<j<k 

with 

i<j<fe i=i ' 
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^ ^ - l)\ 

l<j<k i=l ' 

where, as usual, summations over an empty set mean zero. Notice that 

k k 

i^^yy —l—c{i)y{j-i)y 

^ ^ 

1=1 j=i ^-^ ' 

= yy J_^«„(0/,;+« = yivy ^c^"^-^'^ 
^ ^ ^ i\ ^ i\ 



1=0 1=1 



i=l 1=0 1=0 i=l 



j=0 ■'-1=1 



k j -. ^ hi ^ /)« 



and similarly. 

After that the fact that F = F and G = G follows by simple arithmetics. 
Finally, the last assertion of the lemma immediately follows from Remark 
3.3 and Theorem 3.4 (see however the proof of Theorem 4.1). □ 

4. Proof of Theorem 2.3 

In this section we suppose that m = m. We start with a result which, as 
will be seen later, is more general than Theorem 2.3 . 

Theorem 4.1. Let m = I + k + 1 for some integers l,k > 0, and let As- 
sumptions 2.1, 2.2, 2.3, and 2.4 hold. Then for r^, defined as in Lemma 
3.5, we have 

Esuv \\rm,^ + E T || V'll^^ dt < N\h\'('^+'^ IC^,, (4.1) 
t<T 2 7o 

where N depends only on T, d, n, A, m and KQ,...,Km+i, Aq,..., Am- More- 
over, in the situation of Example 2.2 we have v^^^ = in (3.23) for odd j < k. 

Proof By Lemma 3.5 we have F^ G W^(r) and G'"'' G W'2+^(r), which 
by Lemma 3.5 and Theorem 3.2 yields that the left-hand side of (4.1) is 
dominated by 

NE rm^\\l., + \\Gl\\l.^)dt. (4.2) 



^0 

To estimate (4.2) we observe that for j < k by Remark 3.3 we have 
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Upon combining this result with Theorem 3.4 we see that 



Jo ^ 



Similarly one can estimate the remaining part of (4.2) thus proving estimate 
(4.1). Finally, observe that in Example 2.2 wc have v'^ = due to the 
uniqueness of the L2-valued solution for equation (2.2) with initial condition 
uq. Hence (4.1) yields v^^"* = for odd j < k. □ 

By Sobolev's theorem on embedding of into Ci, for I > d/2 there 
exists a linear operator I : W2 — >■ such that Iip{x) = (p{x) for almost 
every x G M'' and 

sup|/(/j| < Ar||(^||^, 

for all if G 1^25 where iV is a constant depending only on d and I. One 

has also the following lemma on the embedding W2 C ^2(^/1), that we have 
already referred to, when we used Remark 2.3 on the existence of a unique 
^2(G/i)-valued continuous solution {ut{x) : x G Gh\ to equation (2.2). 

Lemma 4.2. For all 99 G Wl^i^^), I > d/2, \h\ G (0, 1) 

E < NM\l,, (4.3) 

x&Gh 

where N is a constant depending only on d and I. 

Proof. By Sobolev's embedding of into C^, for z and smooth tp we 
have 



W{z)\^ < sup cp'^{z + hx)<Ny2h^^'"^ [ \iD'^ip)iz + hx)\'^ dx 
= iV ^ / \{D^<p){x)\^dx<N\h\'^Y f \{D^<p){x)\^ dx, 

\a\<l JBhiz) |a|<r'^''W 

with a constant N = N{d, I), where Br{z) = {x eM.^ : \x - z\ < r}. Thus 

E Hz)m^ ^ ^ E E / \{D-^){^)\'dx 



zeGh \a\<lz€Gh 

that yields (4.3). □ 

Set = Ir^. Recall that A° = {0}, (5/j is the identity operator and 
= 4,Ai • ••• • f^^An for (Ai,...,A„) G A", n > 1. Then we have the 
following corollary of Theorem 4.1 

Corollary 4.3. Let the assumptions of Theorem 4-1 hold with I > n + d/2 

for some integer n > 0. Then for X G A'^ we have 

E sup sup \5h,xB!l{xt < iV/i^C^+D/C^ 
te[o,T] xeRd 
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E sup Yl \Sh,xRlix)\'\hf<Nh'('^+'^JCl 

with a constant N depending only on A, d, m, Kq, K^^^i, Aq,..., A^, 
K, and T. 

Proof. Set j = n — I. Then j > d/2 and using Sobolev's theorem on embed- 
ding W2 into Ch and taking into account Remark 3.1, from Theorem 4.1 we 
get 

E sup sup \Sh,xR'^{x)\'' < CiE sup \\B!i\\lh,n 
<C2E sup <Ar/i2(^+i)/C^, 

tG[0,T] 2 

where Ci and C2 are constants depending only on m and d, and AT is a 
constant depending only on m, (i, T, k, A and Ki for i < m + 1. Similarly, 
by Lemma 4.2 and Remark 3.1 

E sup_ ^ |V^^(a^)l'l^l''<Ci^,sup^JIV^''&,^ 



< C72E sup \\B!i\\l^i < iV/i2(fe+i)/c^. 

te[o,T] 2 



□ 



Now we show that Theorem 2.3 follows from the above corollary. We 
define 

where is the unique J-j-adapted continuous L2(M'^)-valucd solution of 
equation (2.2) with initial condition uq, the processes v^'^\...,v^''^ are given 
by Theorem 3.4, and / is the embedding operator from into Cf,. By virtue 
of Theorem 3.2, v'^ is a continuous W^'^^l^^d process, and by Theorem 3.4 
v^-^\ j = 1,2,...,A;, are W^^'^^^'^-valucd continuous processes. Since I > d/2 
and n + 1 — k > d/2, the processes and u^^^ are well-defined and clearly 
(3.23) implies (2.4) with in place of -u'*. To show that Corollary 4.3 yields 
Theorem 2.3 we need only show that almost surely 

u'lix) = u'lix) for all t G [0, T] (4.4) 

for each x G Gh, where is the unique Ji-adapted Z2-valued continuous 
solution of (2.2). To see this let (p he a compactly supported nonnegative 
smooth function on M'^ with unit integral, and for a fixed x G G/j set 

"Peiy) = f{{y-x)/e) 

for y G M'^ and e > 0. Since ii^ is a continuous L2-valued solution of (2.2), 

for each e almost surely 

/ u^{y)^Mdy= [ u{y)^e{y)dy+ j f {L^,u%) + fs{y))Ve{y) dy ds 
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+ / / {Myu''^{y)+gP{y))<p,iy)dydwP, 
Jo Jr'' 

for all t G [0, r]. Letting here e — t- we see that both sides converge in 
probability, uniformly in t G [0)2^]) and thus we get that almost surely 

u'^ix) = uo{x) + f [L^n^(a;) + ds + f [M^^^^(:r) + gP{x)\ d< 

JO Jo 

for all t G [0, r]. (Remember that uq, f and g are continuous in x by 
virtue of Remark 2.1.) Moreover, owing to Lemma 4.2 the restriction of 
Uf onto G/j is a continuous /2(G/i)-valued process. Hence, because of the 
uniqueness of the /2(G/i)-valued continuous J"f-adapted solution of (2.2) for 
any /2-valued J-Q-measurable initial condition, we have (4.4), that finishes 
the proof Theorem 2.3. 

Theorem 2.3 yields the following generalisation of Theorem 2.4. 

Theorem 4.4. Let the conditions of Theorem 2.3 hold with n = 0. Then 

E'sup sup \v!l{x) — uf'\x)\^ 

t<T xeGh 

+ESUP - < iV|/i|2('=+i)/C^, (4.5) 

t<T 

— xgdj^ 

where is defined by (2.9) and N depends only on A, d, m, Kq, Km+i, 
Ai,...,Ajn, K, and T. In the situation of Example 2.2 estimate (4.5) holds 
also for u^, defined by (2.9), in place of u. 
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